Repository navigation
Run pipelines test against the pipeline's testing.sources - #7429
Merged
Merged
Conversation
This was referenced Nov 10, 2026
Contributor
|
Commit: Regression test reportSelected 8 changed tests (limit=20, 0 not selected) 8 tests: regression=8 unreleased=0 coverage=0 failing=0
TestAccept/pipelines/databricks-cli-help: branch ✅ | main (73a2b68) ❌ | latest (v1.26.0) ❌main (73a2b68): latest (v1.26.0): TestAccept/pipelines/test/arguments: branch ✅ | main (73a2b68) ❌ | latest (v1.26.0) ❌main (73a2b68): latest (v1.26.0): TestAccept/pipelines/test/immutable: branch ✅ | main (73a2b68) ❌ | latest (v1.26.0) ❌main (73a2b68): latest (v1.26.0): TestAccept/pipelines/test/no-test-sources: branch ✅ | main (73a2b68) ❌ | latest (v1.26.0) ❌main (73a2b68): latest (v1.26.0): TestAccept/pipelines/test/not-enabled: branch ✅ | main (73a2b68) ❌ | latest (v1.26.0) ❌main (73a2b68): latest (v1.26.0): TestAccept/pipelines/test/run-control/timeout: branch ✅ | main (73a2b68) ❌ | latest (v1.26.0) ❌main (73a2b68): latest (v1.26.0): 2 more failure details omitted, see the full report in the run. |
Collaborator
❌ Integration test reportCommit: 453fa56 |
tharunbhuk-db
force-pushed
the
tharun/pipelines-test-j1-testing-sources
branch
from
November 10, 2026 01:16
ed5750c to
75f2713
Compare
tharunbhuk-db
changed the base branch from
tharun/pipelines-test-j1-base
to
tharun/pipelines-test-b3-dependency-checks
November 10, 2026 01:16
tharunbhuk-db
force-pushed
the
tharun/pipelines-test-j1-testing-sources
branch
from
November 10, 2026 10:07
75f2713 to
ccdd807
Compare
tharunbhuk-db
changed the base branch from
tharun/pipelines-test-b3-dependency-checks
to
tharun/pipelines-test-b4-testing-deploy
November 10, 2026 10:07
This was referenced Nov 10, 2026
tharunbhuk-db
force-pushed
the
tharun/pipelines-test-j1-testing-sources
branch
2 times, most recently
from
November 10, 2026 11:11
2e9b82e to
a149708
Compare
tharunbhuk-db
force-pushed
the
tharun/pipelines-test-j1-testing-sources
branch
2 times, most recently
from
November 10, 2026 17:14
490849a to
6c31046
Compare
tharunbhuk-db
force-pushed
the
tharun/pipelines-test-j1-testing-sources
branch
from
November 10, 2026 17:22
6c31046 to
bbb4adb
Compare
tharunbhuk-db
marked this pull request as ready for review
November 10, 2026 18:11
tharunbhuk-db
force-pushed
the
tharun/pipelines-test-j1-testing-sources
branch
from
November 18, 2026 09:29
95e39e8 to
3a6c0e5
Compare
tharunbhuk-db
changed the base branch from
tharun/pipelines-test-changelog
to
tharun/pipelines-test-b3-testing-paths
November 18, 2026 09:31
tharunbhuk-db
force-pushed
the
tharun/pipelines-test-j1-testing-sources
branch
from
November 18, 2026 10:10
8b33ae8 to
6983923
Compare
tharunbhuk-db
force-pushed
the
tharun/pipelines-test-j1-testing-sources
branch
from
November 18, 2026 10:23
6983923 to
5986de8
Compare
Contributor
Author
|
@pietern thanks for the review. Reworked the stack, ready for another look: it is now 3 PRs (#7427 → #7437 → #7429).
|
andrewnester
approved these changes
Nov 18, 2026
github-merge-queue
Bot
removed this pull request from the merge queue due to invalid changes in the merge commit
Nov 18, 2026
Base automatically changed from
tharun/pipelines-test-b3-testing-paths
to
main
November 18, 2026 12:10
The pipelines test acceptance bundles declare testing, as the service requires testing.sources for a test-only update. When Start Update fails with PIPELINE_TEST_NO_TEST_SOURCES and the bundle sets testing for the pipeline, the error says to deploy first: the bundle changed after its last deploy. Add a live acceptance test that deploys a bundle with testing, including a local test dependency after -e, and runs its tests. Locally it uses stubs for the test run. Against a real workspace it runs only when TEST_PIPELINES_TESTING_ENABLED is set. Co-authored-by: Isaac <no-reply@databricks.com>
The command no longer needs DATABRICKS_CLI_PIPELINES_TEST=true. Whether a workspace can run pipeline tests is decided by the service, so a run of all tests now always sends test_options, empty when nothing is selected. Where the testing API is off, the service rejects such a request with a clear error, instead of running its older test-only update. Co-authored-by: Isaac <no-reply@databricks.com>
The command no longer needs an environment variable to run. Co-authored-by: Isaac <no-reply@databricks.com>
Co-authored-by: Isaac <no-reply@databricks.com>
Co-authored-by: Isaac <no-reply@databricks.com>
Co-authored-by: Isaac <no-reply@databricks.com>
Co-authored-by: Isaac <no-reply@databricks.com>
tharunbhuk-db
force-pushed
the
tharun/pipelines-test-j1-testing-sources
branch
from
November 18, 2026 12:10
5986de8 to
7ca3bea
Compare
Contributor
Author
|
/merge |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
🥞 Stacked PR
databricks pipelines testruns without an environment variable. Its help marks it Beta, so it stays unstable under the stability policy.test_optionsas an empty object, so a workspace that does not support it returns a clear error.pipelines testacceptance bundles declaretesting, since test runs needtesting.sources.PIPELINE_TEST_NO_TEST_SOURCESand the bundle setstesting, the error says to deploy first.testingproperty.Tests:
TestNewStartTestUpdateRequest,TestWithDeployHint; acceptancepipelines/test/not-enabled,pipelines/test/no-test-sources,pipelines/databricks-cli-help, and thepipelines/testgoldens without the gate cases.This pull request and its description were written by Isaac.